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We consider the equilibrium dynamics of Ising spin models with multi-spin interactions on sparse 
random graphs (Bethe lattices). Such models undergo a mean field glass transition upon increasing 
the graph connectivity or lowering the temperature. Focusing on the low temperature limit, we 
identify the large scale rearrangements responsible for the dynamical slowing-down near the transi- 
tion. We are able to characterize exactly the critical dynamics by analyzing the statistical properties 
of such rearrangements. We obtain a precise crossover description of the role of activation at the 
transition. Our approach can be generalized to a large variety of glassy models on sparse random 
graphs, ranging from satisfiability to kinetically constrained models. 

PACS numbers: 75.50.Lk (Spin glasses), 64.70.Pf (Glass transitions), 89.20.Ff (Computer science) 



X 



Understanding the slowing down of relaxational dy- 
namics in glass-forming liquids is an important open 
problem in statistical physics. Two points of view have 
been developed in the last years. Mode coupling theory 
(MCT) is based upon a "self-consistent" closure of dy- 
namical equations, and predicts an ergodicity-breaking 
transition at temperature Tj. It was later shown that 
MCT is exact for a class of fully-connected (FC) mean- 
field models, the dynamical phase transition (DPT) being 
related to the proliferation of metastable states 0, |^ ■ 

According to an alternative point of view, the dynam- 
ical slowing down in supercooled liquids can be traced 
back to the increasing cooperativity of the dynamics Q . 

It is a recent discovery that MCT implies diverging 
correlations as the is approached |^]. This hints at 
a possible convergence among the above points of view, 
and may lead to universal predictions. However, the rela- 
tion between a diverging correlation length and dynam- 
ical slowing-down remains qualitative. This paper aims 
at filling this gap. By analyzing a particular case, we 
will show that a detailed picture of the critical dynamics 
can be obtained through the analysis of highly correlated 
regions whose size diverges at the transition. Several fea- 
tures of MCT are recovered, despite no exact set of MCT 
equations holds in the system considered here 0. 

A further source of motivation comes from the discov- 
ery that several ensembles of hard optimization problems, 
such as satisfiability and coloring, undergo a mean-field 
DPT 0. An interesting question in this context is: how 
much time a Monte Carlo (MC) algorithm needs for sam- 
pling a low-cost configuration of the problem. Further- 
more, a phase transition of the same type, is found in 
a large variety of other models on random graphs, from 
kinetically constrained models, to rigidity percolation 

Finally, there has been a lot of interest in the role of 'ac- 
tivated processes' in glasses 0. In (spherical) FC models 
free energy barriers vanish above Td while they are ex- 
tensive (in the system size N) below. Activation does 
not play any role: it is not necessary above Td, and it is 



ineffective below. Schematic MCT does not include ac- 
tivation and is exact for such models, predicting a sharp 
transition. This picture can be modified in two ways: 
(A) Requiring barriers to stay finite below Td- In finite- 
dimensional models, this is a consequence of nucleation 
effects. Activation over such barriers induces a finite time 
scale for ergodicity restoration, and a smearing of the 
transition. (B) Introducing finite barriers above Td while 
keeping extensive ones below. This is the scenario in di- 
luted mean field models, such as the one treated below. 
While the transition remains sharp, the presence of new 
(activated) relaxation mechanisms may change the slow- 
ing down as T I Td, (e.g. the critical exponents). 

In this paper we address the problem (B) above. Since 
in any realistic (finite-dimensional) model crossing over 
finite-energy barriers exists at any temperature, it is im- 
portant to understand if this may modify some key pre- 
dictions of MCT. In particular, we shall consider a regime 
in which the distinction between activated and non- 
activated processes has a precise mathematical sense, i.e. 
in the neighborhood of a T = bicritical point. 

Our approach is to study a class of large scale rear- 
rangements (LSR) which we expect to control the slow 
dynamics. Let us begin by providing a loose description 
of the main ideas on the example of a particle system. 
Consider a low-T j2ll | equilibrium configuration and fo- 
cus on a particular molecule at position Xi . Now impose 
a displacement 6xi (a few intermolecular distances) on 
this molecule and ask what is the minimum number 
of other molecules which must be moved for this displace- 
ment to be possible. The minimum energy barrier bi to 
be overcome is a second important property of the dis- 
placement 6xi. A glassy state is characterized by very 
large sizes n^'s and barriers 5i's (diverging at a sharp 
DPT) leading in turn to large relaxation times. A third 
quantity is defined by allowing all the molecules within 
a distance £ around Xi to be moved. Let ii be the mini- 
mum £ such that the displacement Sxi can be performed. 
It turns out that n.i <^ £f (at high enough dimension d). 
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FIG. 1: Schematic view of the phase diagram of the diluted p- 
spin model, with its dynamical and static transition line. See 
the text for details on the two type of divergences encountered 
at the dynamical transition. The scaling hypothesis of Eq. ^ 
is expected to hold in the shaded region. 

Remarkably, molecular dynamics simulations found 
string-like motions in glass-forming liquids. 

Such notions can be completely precised in specific 
models. In this paper we focus on Ising models with 
p-spin {p > 3) interactions: 

= ^ E i^~J^.■■■^.<^^.■■■<^^.): (1) 
(il-..ip)e5 

Here (7^ = ±1 are N Ising spins, ^ is a set of M = 
p-uples of indices, and Ji^...ip are quenched couplings 
taking values ±1 with equal probability. The above 
Hamiltonian counts the number of violated constraints 
■ ■ • <Ji = Jii...i ■ This model is known in computer 
science as XORSAT 

A mean field version of this model is obtained by tak- 
ing the M interacting p-uples of sites {(zi . . . ip)} to be 
quenched random variables uniformly distributed in the 
set of (f^) possible p-uples the limit N ^ co, 

the number of interactions a given spin belongs to (its 
connectivity) is a Poisson random variable with parame- 
ter pj. Moreover, the shortest loop through such a spin 
is (typically) of order log^^ N. The phase diagram is 
sketched in Fig. ^ Two regimes have attracted a par- 
ticular attention. In the "fully-connected" limit 7 — > cxd, 
T (X y/j, both statics and dynamics can be treated ana- 
lytically, showing a typical MCT transition. The relax- 
ation time diverges as |T — Td]""^, while a true thermo- 
dynamic transition takes place at Tc. 

In the T I 0, finite 7, limit, probabilistic methods can 
be used to show that zero-energy ground states with fi- 
nite entropy density exist for 7 < 7c. The set of ground 
states gets splitted in an exponential number of clusters 
with extensive Hamming distance (number of spins with 
different value) separating them for 7d < 7 < 7c 0|- A 
finite fraction of the spins does not vary within a particu- 
lar cluster, while they change when passing from a cluster 
to the other. At 7d the fraction of "frozen" spins jumps 
from to a finite value (j). For instance 7d ~ 0.81847, 
7c « 0.91793, and cj) « 0.71533 when p = 3. No exact 
result exists for the dynamics in this regime Q. 
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FIG. 2; Top: an optimal ordering for this rearrangement F. 
The numbers indicate the energy along the trajectory, here 
b{F) — 2. Bottom: example of the recursive construction for 
I = 3, j = 2. Bubbles stand for generic rooted sub-trees. The 
numbers give the maximal energy in each epoch. 

In the region T < (7) , the Gibbs measure splits into 
an exponential number of pure states separated by bar- 
riers of order N. However this implies little (if anything) 
on the correlation time behavior as T | 1^1(7). In agree- 
ment with our general philosophy, we shall analyze the 
dynamics in terms of LSR's as the transition line 1^1(7) 
is approached. The discussion below concerns any single- 
spin-flip Markov dynamics satisfying detailed balance. 

Notice that a diverging length cannot be defined 
through a standard spin-glass correlation function, which 
remains short-ranged at Td(7). In order to overcome this 
problem, consider any temperature T > Td(7) and fix a 
reference thermalized configuration aj-^^ a site i, and a 
length £. Denote by {cri)i the Boltzmann average of ai 
under the boundary condition aj = crj°^ for any site j 
at a distance larger than £ from i. Define £i{e) to be the 
smallest value of £ such that (jf^ (ai) < e [s being a small 
fixed number). A standard recursive calculation yields 
£^{e) ^{T- rd(7))-'/' as T i Td{j). A coupling argu- 
ment from probability theory can be used [ij, ll5j to show 
that this implies a correlation time r > (T — Td(7))~"'^/^. 

The above argument displays clearly the relation be- 
tween length and time scales. However the estimate for 
T is not tight (the exponent is incorrect). As we shall see 
next, a highly refined picture can be obtained as T —^ 
in the "liquid" phase 7 < 7d. In this regime, the sys- 
tem will spend most of its time in quasi-ground states. 
For the sake of the argument, assume that it is in fact 
in a ground state and focus on a particular spin ai. The 
leading mechanism for ai to relax consists in a trajectory 
in phase space which brings the system to a new ground 
state with a reversed value of ai. Let Fi be the set of 
reversed spins between these two ground states. This set 
must contain i and, for each interaction (ii . . . ip) € G, an 
even number of these p sites. As will be clear from the fol- 
lowing, we can restrict in fact to those Fi^s which are con- 
nected, and such that, for each interaction (ii . . . ip) G G, 
either two or none of the sites belong to Fi . In the present 
context, we call Fi a rearrangement for the spin ai. 

Each Fi can be assigned a barrier b{Fi), defined as 
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the minimum over all (single-spin-flip) paths in config- 
uration space which flip the spins of Fi, of the maxi- 
mum energy along the path. Assume that each spin in 
is flipped only once: paths are thus defined by an 
ordering of the flipped variables. A relaxation time for 
Ui can be defined by considering the correlation func- 
tion Ci{t) = {ai{t)(Ji{Q)) and requiring Ci{Ti) — e for 
some fixed e (in the following e = 1/2). At low tem- 
perature, Arrhenius law implies ^ exp[/?6i], with 
bi = miuF. b{Fi). 

Computing bi requires optimizing both over the choice 
of the rearrangement Fi (the set of spins to be flipped) , 
and over the paths in configuration space (the flipping or- 
der). Consider this second task for a given rearrangement 
Fi. Form the graph with vertices representing the spins 
of Fi, and links between spins belonging to a common 
interaction in Q. If Fi stays finite in the thermodynamic 
limit, this graph is a tree rooted at i. If one draws this 
tree with vertices placed on an horizontal axis according 
to the order in which the spins are flipped, the energy of 
the system at a certain point of the trajectory is simply 
the number of links drawn above this point, cf. Fig. |21 
This ordering problem is studied in graph theory as min- 
imal cutwidth [id. Iivj. 

A simple (and essentially optimal jlJ|) strategy to con- 
struct recursively such an ordering is the following. As- 
sume that the site i = has I neighbors {1 . . .1} = [1, 1], 
each one being the root of a sub-tree. Then choose a 
sequential ordering of the sub-trees, i.e. a permutation 
P of [1, and an integer j e [0, 1]. Flip all the variables 
of the sub-tree Pi , then do the same on the tree P2 , and 
so on until Pj, then flip the ctq, and finally flip the spins 
in the sub-trees Pj+i, . . . ,Pi. As "proved" in Fig. 13 this 
construction implies a recursion on the energy barriers 

60 = min max[ bp^,l + bp^, . . . J - 1 + bp (2) 
I- j - l + r + bp^^^ ,...,r + bp ] , 

with r = 0. The fe^'s are "modified barriers" which obey 
a similar recursion: bo is given by Eq. (jSJ with r = 1. 

The computation of the barrier bi for the p-spin in- 
teraction problem still involves an optimal choice of the 
rearrangement Fi. This step can also be performed re- 
cursively: starting from the root i, one chooses in each 
interaction around it the variable a (among the p ~ I 
distinct from i) which minimizes 6q. Repeating this step 
one obtains an admissible rearrangement Fi for ai, with 
a minimal value of b{Fi). Remarkably, this scheme can 
be efficiently implemented on a given sample 14] . 

If we consider the ensemble of random hypergraphs 
Q described above, the barriers bi become themselves 
random variables, and Eq. ^ acquires a distributional 
meaning. The law Qb = Prob[6i > b\ can be computed 
numerically and is plotted in Fig. 01 for a few values of 7 
approaching 7d. Notice that Qb has an immediate physi- 
cal interpretation in terms of the global correlation func- 
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FIG. 3: Bottom: integrated law for the distribution of barrier 
heights. Top: geometrical susceptibility. 

tion C{t) — ^i{<^i{0)o'i{t)) ■ At time t only those sites 
with bi > Tlogt contribute to the correlation function. 
We thus have hm^^^o C(e''(''-^)) = Qb for any < (5 < 1. 
The critical behavior of Qb can be solved analytically. 
As 7 approaches 7d a plateau develops at height </>: a 
fraction (j) of the spins have "large" barriers (are freez- 
ing), while the other ones have "small" barriers. As the 
plateau is approached (left) one has Qb — 4> + C_e~'^°^ 
(Qb ~ — C+e"*"^) with uja/b the positive solutions of 
the equations 26"" - e^"" = 26""" - e"^"" ^ A, and 
A a p-dependent parameter. Finally the scale of the 
large barriers diverges as 6siow — — Tlog(7d — 7), with 
T = l/(2(jja) + l/(2ijJ6). For instance, if p = 3 we get 
LUa w 0.57432, ujb ~ 1.49574, and T « 1.20488. The 
reader will notice the close parallel with the behavior 
of correlation functions in MCT, with some definite dif- 
ferences: here the divergence is logarithmic rather than 
power-law; the exponents are no longer fixed by a tran- 
scendental relation (see below), but rather through the 
above quadratic equations for e'^"/''. 

Arrhenius law yields a correlation time diverging as 
T ~ (7d — 7)"*^^ if the 7 — > 7d limit is taken after T ^ 0. 
Inspired by the crossover behavior in diluted ferromag- 
nets we conjecture the following scaling form to hold 
if 7 ^ 7d together with T ^ 0: 

T(/3,7)~e^/(e'5(7-7d)). (3) 

This summarizes the above findings, as well as the low- 
T behavior of the dynamic transition line 14]: 7d(/3) — 
7d -I- a:*e~^ with x* ~ 9 for p = 3. The scaling func- 
tion behaves as f{x) ~ e~^^'°s|a:|) x ^ —00, and 
/(x) ~ f+\x* - x]-''(°°) as X ^ > 0. In Fig. H 
we check the scaling hypothesis against numerical simu- 
lations. Remarkably, Eq. (PJ implies a super-Arrhenius 
behavior at 7d: T(/?,7d) oc e^^ 

Several geometrical properties of optimal (minimum 
barrier) LSR's can be determined analytically. Their size 
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FIG. 4: The scaling function of Eq. ^ (notice the large cor- 
rections to scaling for 7 > 7d). Inset: super- Arrhenius behav- 
ior at 7d. 

(number of sites) diverges as nbar ^ (7d — j^^'^b^.r^ with 
i^bar ~ 2.0157 for p = 3. They are non-compact: the 
cheniical distance between the root and a random site in 
an optimal LSR scales as (7d — 7)"^, with universal expo- 
nent C — 1/2. Further, optimal rearrangements induce 
dynamical correlations, as can be understood from the 
following "experiment". Consider a site j ^ i, and ask 
what is the minimum barrier to be overcome for flip- 
ping Ui without flipping Oj. Call q\^'^ = Prob[fe-''^ > b], 
and define the "susceptibility" Xb = TlijlQ^b^ ~ Qb\- As 
T — > 0, Xb describes the change in Ci(t) when a pinning 
field is applied on spin Oj (summed over j), and is a geo- 
metric analogous of the 4-point susceptibility introduced 
in We show in Fig. O its critical behavior. The 

main feature is a peak located at 6pcak — — T log(7d — 7) 
whose height Xpeak ~ (7d — 7)"'' (with universal expo- 
nent r] — \) estimates the number of spins Gj which are 
influential to the dynamics of Oi , belonging to all minimal 
barrier rearrangements for this variable. 

How does our picture generalize to the 7 > 7d, 
T i 2d (7) regime? Summarizing, we presented two 
types of results: (i) dynamics proceeds by LSR's of size 
n ~ (7d — {ii) the energy barriers to be overcome 

scales as 5 ~ ^actlogri, with Zact — T/:/. The equili- 
bration time was estimated as r ~ e^^ ~ n'^^""'. At fi- 
nite temperature, the Arrhenius argument does not make 
sense any more, and one cannot understand slowing down 
in terms of activated processes. However, we still expect 
that LSR 22] sizes diverge as n ~ (T - Td{-f))~''^^\ and 
that a dynamical scaling relation t ^ holds with an 
universal exponent z. A partial confirmation is provided 
by the probabilistic argument discussed in the previous 
pages implying r > (T - Td(7))"^/2. 

How is this related to the issue (B) raised in the in- 
troduction? The depth and cooperativity of LSR diverge 
with two universal exponents ^ — 1/2 and 77 = 1. This 
agrees with MCT calculations 5] implying that such uni- 
versal features of MCT are not modified by activated pro- 
cesses, even in the regime ^ (7d~7)- Other features 
(e.g. the relation r(l -a) Vr(l- 2a) = T{l+b)^ /r{l+2b) 
between a- and /3-relaxation exponents) are indeed mod- 



ified in a crossover region that can be experimentally rel- 
evant. However, the asymptotic T | 7d(7) behavior is 
governed by usual MCT at any 7 > 7d. The crossover be- 
tween the two regimes is ruled by the ratio (7 — 7d)~^/e''- 
In a more general context one should consider the ratio 
^dyn/Cthorm, whcre ^dyn IS a dynamical length scale as 
measured through 4-points correlations |^, and ^thorm is 
a thermal length (distance between energy defects). 

The above ideas can be applied to particle systems. In 
the particular case of kinetically constrained models on 
Bethe lattices 0, we could show that the same scenario 
described above holds 0| . A challenging direction would 
be to analyze ensembles of NP-hard decision problems 
(random if-SAT, or the g-coloring of random graphs) 
with a similar phase diagram |2fil | . Finally, we obtained a 
purely geometrical description of diverging spatial struc- 
tures at the DPT. This provides a particularly concrete 
setting for discussing finite-dimensionality effects. 

We thank Leticia Cugliandolo for her interest in this 
work. G.S. has been partially supported by the EU under 
the EVERGROW project. 
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